Virtual asset map and index generation systems and methods

ABSTRACT

A system for generating a nearest neighboring vertices index. The system includes a memory and one or more processors. The one or more processors receive a base figure asset and an item asset, determine nearest neighbor vertices between the base figure asset and the item asset using at least one of a k-dimensional tree algorithm and a geodesic algorithm, and generate the nearest neighboring vertices index based on the determined nearest neighbor vertices between the base figure asset and the item asset.

RELATED APPLICATION

This application claims the benefit under 35 U.S.C. § 119(e) of U.S.Provisional Application No. 62/415,835 filed Nov. 1, 2016, which ishereby incorporated by reference herein in its entirety.

TECHNICAL FIELD

The present disclosure relates to electronic or other virtualrepresentations of an individual or entity in a computer generatedenvironment. In particular, the present disclosure relates to systemsand methods for portable and persistent virtual identity acrossapplications and platforms.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a system diagram for a persistent virtual identity system,according to one embodiment.

FIG. 2 is a block diagram of artist tools, according to one embodiment.

FIG. 3 is a flow chart for generating a nearest neighbor vertices index.

FIG. 4 is a flow chart for generating an occlusion index and an alphainjection map.

FIG. 5 is a flow chart for generating a heterogeneous mesh behaviorindex.

FIG. 6 is a block diagram of an identity system, according to oneembodiment.

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS

A detailed description of systems and methods consistent withembodiments of the present disclosure is provided below. While severalembodiments are described, it should be understood that the disclosureis not limited to any one embodiment, but instead encompasses numerousalternatives, modifications, and equivalents. In addition, whilenumerous specific details are set forth in the following description inorder to provide a thorough understanding of the embodiments disclosedherein, some embodiments can be practiced without some or all of thesedetails. Moreover, for the purpose of clarity, certain technicalmaterial that is known in the related art has not been described indetail in order to avoid unnecessarily obscuring the disclosure.

Techniques, apparatus, and methods are disclosed that enable a renderingprocess for generating indexes and maps that are used for variousruntime algorithms to make numerous real-time rendering operationspossible. Examples of the rendering processes include a neighborvertices index, a polygon occlusion index, an alpha injection map, and aheterogeneous mesh index.

A neighbor vertices index represents a given vertex for a following 3Dasset (sometimes referred to as an item asset) and the nearest weightedneighboring vertices in the base 3D asset as dictated by averagedistance to signify influence of the base asset (sometimes referred toas a base figure asset) on the given vertex. Neighboring vertices can benumbered between 1 and N where N is the number of vertices in the base3D asset. In some embodiments, two different methods can be selected fordetermining the nearest neighbor, and/or a combination of those twomethods can be selected as well. The methods include a k-d tree(k-dimensional tree) and traversing the geometry using geodesicalgorithms on a combined mesh of the following 3D asset and base 3Dasset. In artist tools a method can be provided for the creators ofassets to override the generated neighbor vertices index by selection ofa point and hand picking the vertices from the base 3D asset from whichto derive influence. This allows the artist to hand tweak the results toget the exact results the creator of the following 3D asset wants. Withthe neighboring vertices data, the system creates indexes for quicklookup results. Examples of the indexes include keyed by base 3D assetvertex, base 3D asset polygon, following 3D asset vertex, influencingbones, or grouped by region such as head, body, arms, legs, hands, etc.

A polygon occlusion index and alpha injection map process creates boththe occlusion index and the alpha injection map. The index representswhat polygons in the base 3D asset the following 3D asset is fullyoccluding and partially occluding. The map is a per pixel representationof the area that the following 3D asset covers the base 3D asset as itis represented in UV space (which, in some embodiments, representsapplication of a 2D UV map in UV space to a 3D object in XYZ space). Useof this index and map is for algorithms that will fix multilayered depthissues and aid in combining meshes and textures into a single geometry,for example, the base 3D asset and following 3D asset loaded. With bothassets loaded the system traverses both the polygons of the following 3Dasset and, using ray tracing, shoot a ray from each vertex and thecenter points of the polygon from both sides of the polygon at a90-degree angle from the plane of the polygon to determine occlusion.Another method and optimization includes taking the bounding box of thenon-edge polygons in the following 3D asset and doing a direct overlayon the base 3D asset. The system flags everything within that boundingbox where there is an overlap as fully occluded, significantly reducingthe number of polygons from which to shoot rays. Using the generatedpolygon hit and overlay data generated with the ray trace technique, animage map is generated that mimics the UV map of the base 3D asset butrepresents the parts of the UV map where the polygons of the following3D asset overlay. Using the UV map and overlay, the projected image ofthe following 3D assets is used to generate a new image that is theoverlaid parts to give a pixel representation of what is occluded on thebase 3D asset.

A heterogeneous mesh behavior index enables normal geometry representingform fitting material that will deform differently than metal or flowingdynamic cloth. When an underlying figure is made taller or moremuscular, normal geometry deforms in the X, Y, and Z axes in the sameamount as the base 3D asset. Other materials, such as metal, stay rigidand do not scale, or scale in an equal rate, such as a rate of 1:1:1, asthe figure scaled along a given axis. This heterogeneous mesh index (orheterogeneous mesh behavior index) is a representation of polygons andvertices, or groups of polygons and vertices correlated to a kind ofreal world material behavior (such as what pivot points it would scale,rotate, or transform from, and behavior relationships along directionsof the X, Y, and Z axes).

In some embodiments, UV space represents a two dimensional texture mapwith axes of U and V that map onto a surface of a 3D object.

Individuals are increasingly interacting with computing devices,systems, and environments and with other individuals in electronic orvirtual forums, such as in computer games, social media and otherInternet forums, virtual/augmented reality environments, and the like,sometimes referred to as cyberspace. These electronic interactions,whether individual-machine interactions or individual-individualinteractions, increasingly are facilitated by a concept of virtualidentity for each party to the interaction, which may be referred to asan application identity. The virtual identity enables a given party toidentify itself to other entities in an interaction and/or enables otherparties to recognize or identify the given party during the interaction.

A virtual identity can be embodied as simple as a profile, and can bemore complex such as including an avatar or other graphicalrepresentation, a persona (e.g., an aspect of character of the virtualidentity that is presented to or perceived by others), and/or areputation (e.g., beliefs or opinions that are generally held about thevirtual identity). In virtual reality (VR) applications, virtualidentity can be very complex in order to provide a fuller, richeridentity to other entities in VR encounters or other interactions. Avirtual identity can be used to associate application data with a user.For example, a virtual identity can be used to correlate user data,application settings, pictures, and/or profiles with users, among othertypes of application data.

Presently, virtual identities are limited to a single application (e.g.,specific to a given application and nontransferable to otherapplications). That is, a user may create a virtual identity for a givenapplication and that virtual identity is not portable to, or persistentin, a different application. A user must create a separate virtualidentity to use with each of a plurality of applications. As such, theuser may have the burden of managing and/or maintaining a plurality ofvirtual identities. If the user experiences a change (e.g., a change ofname, address, phone number, or the like), or desires to effectuate achange to a virtual identity (e.g. a change of an aesthetic feature suchas an icon), then the user may have the burden of propagating the changethrough a plurality of virtual identities, each corresponding to adifferent application.

As virtual identities grow more complex and detailed (e.g., includinggreater amounts of associated information) the burden on a user may befurther enhanced. For example, if the application identity is associatedwith a virtual application having a visual aspect, then the virtualidentity may include a virtual avatar and other types of data associatedwith the virtual identity. A user may create, manage, and/or maintain adifferent virtual avatar for each of a plurality of virtualapplications. If a user makes a change to an avatar associated with onevirtual identity (e.g., a change of hair color), the user would need tothen make the same change to the avatar associated with each othervirtual identity in which the user may interact. In other words, if auser wants consistent (e.g., identical or similar) virtual identitiesacross multiple applications, then when the user changes the hair color(or most any other visual aspect, such as shape, height, muscledefinition, tattoos, sex, art style, default animation sets) of anavatar (e.g., a bipedal humanoid character) for a given virtual identityin one application the user will also have to make that same change forall other applications in which the user desires the correspondingavatars and/or virtual identities to be consistent.

A persistent virtual identity (e.g., including such aspects as anavatar, persona, reputation, etc.) that is portable across applicationsand/or platforms may be desirable. In some embodiments of the presentdisclosure, a single persistent virtual identity can be created,managed, and maintained for (and may be portable to) a plurality ofapplications, platforms, and/or virtual environments, whether social,business, gaming, entertainment, or any other platform that facilitatesor otherwise wants users to have a visual presence in it.

An application can be a standalone computer program. An application canbe a computer program to perform a group of coordinated functions,tasks, or activities for the benefit of a user. A video game may be anexample of an application. An application that is a standalone computerprogram may optionally include or interact with online or remotelylocated components, such as data stores and cloud computing resources. Aplatform can be a group of different applications, services, and/orcomputing resources that provide a broader service. A platform can be orotherwise provide the environment in which an application is executed,and may include the hardware or the operating system (OS), or otherunderlying software (e.g., the stage on which applications and othercomputer programs can run). A platform may be heavily tied to ordirected to an online functionality, such that the differentapplications, services, and/or computing resources may be distributed,or remotely located and interconnected via a network. A platform canprovide a computing environment for a virtual environment (e.g., avirtual world). A persistent virtual identity can be developed and/oremployed in multiple applications, platforms, and/or virtualenvironments.

Reference is now made to the figures in which like reference numeralsrefer to like elements. For clarity, the first digit of a referencenumeral indicates the figure number in which the corresponding elementis first used. In the following description, numerous specific detailsare provided for a thorough understanding of the embodiments disclosedherein. However, those skilled in the art will recognize that theembodiments described herein can be practiced without one or more of thespecific details, or with other methods or components. Further, in somecases, well-known structures, or operations are not shown or describedin detail in order to avoid obscuring aspects of the embodiments.Furthermore, the described features, structures, or characteristics maybe combined in any suitable manner in one or more embodiments.

FIG. 1 is a system 100 diagram for a persistent virtual identity systemaccording to one embodiment. The system 100 can include 3D content 102,a content conversion system 106, artist tools 108, an asset lookup anddelivery service 110 (and/or library), content standards 114, an assettransfer client 116, a 3D character SDK 118, and a ready room in virtualreality (VR) 120. The system 100 can also include brand modules 112 a,112 b, 112 c, and 112 d (sometimes referred to generally andcollectively as “brand module(s) 112”). The system 100 can include aplurality of applications 122 a, 122 b, 122 c, 122 d (sometimes referredto generally and collectively as “application(s) 122”) As can beappreciated, in some embodiments the applications 122 may be on a singlecommon computing platform (e.g., in a common VR environment). In otherembodiments, one or more on the applications may be on different, uniquecomputing platforms. A user may interact with the system 100 by way of auser interface 124 that interfaces via the applications 122 and/or theready room VR 120. The user interface 124 may be or operate on a usercomputing device. A user of the system 100 may include electronic users,such as a bot or an AI application, in addition to human users.

The system 100 can provide the ability to create and/or maintain apersistent virtual identity and/or a corresponding 3D asset(s), and toenable transport of such between applications (e.g., different games)and/or platforms (e.g., different augmented reality (AR) or VR systems).As used herein, the persistent virtual identity can include a base 3Dasset (e.g., an avatar model and modifications thereto), following 3Dassets (e.g., clothing, accessories, etc.), history associated with auser of the system, social reputations, social standing, inventory,wardrobe (e.g., additional clothing following 3D assets, which mayinclude pre-saved outfits), and/or trophies, among other itemsassociated with the persistent virtual identity. A virtual identity mayinclude multiple 3D assets, which can include one or more base 3D assets(e.g., multiple avatars) and one or more following 3D assets. The 3Dasset(s) can be at least partially defined using geometric data. The 3Dasset(s) can further be presented as an avatar associated with thepersistent virtual identity. For sake of simplicity, a “3D asset”referenced hereafter may be a base 3D asset, a following 3D asset, or acombination of one or more of these.

The applications 122 can be VR applications. The applications 122 can beindependent of each other. The applications 122 can be gamingapplications, social media applications, instructional applications,business applications, and/or any other type of application employing VRtechniques. The brand modules 112 can provide conformity standards forthe applications 122. That is, a 3D asset generated in the system 100can conform to the standards defined by the brand modules 112 to becompatible with the respective applications 122. The applications 122may all be on a single platform (e.g., HTC Vive®, Oculus Rift®,PlayStation VR®), or may be on different platforms.

In some examples, the applications 122 and/or the brand modules 112 canbe external to the system 100. That is, the applications 122 and/or thebrand modules 112 can be implemented independent of the system 100(e.g., separate and distinct from the ready room VR 120, the assetlookup and delivery service 110, and the content standards, 114,although interfacing or otherwise communicating such as through an API).The applications 122 and the brand modules 112 are correlated. Stateddifferently, the brand modules 112 correspond to and provide standards,rules, protocols, and/or the like for the applications 122. For example,the application 122 a is associated with the brand module 112 a, theapplication 122 b is associated with the brand module 112 b, theapplication 122 c is associated with the brand module 112 c, and theapplication 122 d is associated with the brand module 112 d.

The system 100 can enable a persistent virtual identity that is portableand persistent to exist and be transported between the applications 122.A developer and/or a user can integrate or otherwise interconnect withthe system 100 (e.g., via applications 122 and/or user interface 124,and generally over a network) to both create a persistent virtualidentity, and potentially to interact with other persistent virtualidentities created by and corresponding to other users. The user and/orthe application developer can exercise control over the createdpersistent virtual identity. For example, the user can, through the userinterface 124, interconnect with the ready room VR 120 to manipulate thevirtual identity. The user can also manipulate the virtual identitythrough applications 122. FIG. 1 shows the user interface 124interconnected with the system 100 through the ready room VR 120 and theapplication 122 b.

The system 100 can include a three dimensional (3D) character softwaredeveloper kit (SDK) 118 (e.g., an MCS Plugin). The 3D character SDK 118may be a library that can be implemented in an application 122. The 3Dcharacter SDK 118 includes functionality to perform operations likecreate 3D assets (e.g., avatars, in a scene), shape them, add/removeclothing and other following 3D meshes, etc. The 3D character SDK 118also includes functionality to obtain 3D models (for base 3D assets) andaccompanying information from the local cache (and if a 3D model and/oraccompanying information isn't in the local cache, the 3D character SDK118 can transparently fetch the 3D model and/or accompanying informationfrom the cloud). The 3D character SDK 118 can also transform 3D modelsinto game ready objects, namely 3D assets. The 3D character SDK 118 canalso provide other asynchronous operations, which provides an event ortask queue.

The system 100 can also include an asset transfer client 116 (e.g.,ready room plugin) and an asset lookup and delivery service 110 (and/orlibrary). The asset transfer client 116 and the asset lookup anddelivery service 110 can be local and/or remote to the system 100. Thatis, the asset transfer client 116 and/or the asset lookup and deliveryservice 110 can be executed (e.g., hosted) on a network computing deviceremote to the system 100 that can be accessed by the applications 122.As used herein, the asset lookup and delivery service 110 allows theasset transfer client 116 to request a specific 3D asset withpermutations on the request for specific level of detail, material, andtexture variation. The asset lookup and delivery service 110 can alsoprovide (e.g., stream) the 3D asset to the asset transfer client 116. Asused herein, a material may be a combination of texture files, shaders,and different maps that shaders use (normal map, occlusion map) andother data such as specularity and metallic levels depending on thematerial type. A material may be a visual layer that makes somethingwithin a 3D asset look like more than just polygons.

The asset transfer client 116 can include two or more componentsremotely located from each other and communicating together, such asover a network. A first component of the asset transfer client 116 canbe implemented in the user interface 124 and/or the applications 122. Asecond component of the asset transfer client 116 can be implemented inthe system 100. The first component of the asset transfer client 116 cancommunicate with the second component of the asset transfer client 116,for example to request a 3D asset. The component of the asset transferclient 116 implemented in the system 100 can request or otherwise obtainthe 3D asset from the asset client lookup and delivery service 110.

The system 100 can also include the content standards 114 which includesstandards for the brand modules 112 and/or the applications 122. Thecontent standards 114 can specify types of content or groups of contentbased upon the creator of the asset, the genre of the asset, or the artstyle of the asset. The content standards 114 can specify types ofcontent or groups of content through the use of filters. The filters canoperate on metadata associated with the 3D assets comprising the contentor groups of content. The metadata can identify a vendor from which the3D asset originated, a genre of the 3D asset, and an artistic style ofthe 3D asset, among other types of data included in the metadata.

A genre can include, for example a fantasy genre, a science fiction(sci-fi) genre, a comic book genre, and/or contemporary genre, amongother genres. An artistic style can be defined by vendors who create newartistic styles. The system 100 can have a default artistic style suchas a Nikae artistic style and a Minecraft-esque artistic style.

The content standards 114 can also specify what types of 3D assets areallowed in respective applications 122 and/or what types of 3D assetsare not allowed in respective applications 122. For example, the contentstandards 114 can define that 3D assets with a default artistic styleand a fantasy genre are allowed in a given corresponding application 122c and that 3D assets of a different artistic style and a different genreare not allowed in the application 122 c.

The content standards 114 can also specify that 3D assets originatingfrom a particular vendor are allowed in a corresponding application fromthe applications 122. For example, the content standards 114 canrestrict the transfer of 3D assets to the application 122 d to 3D assetsthat were originated by a vendor of the application 122 d.

The content standards 114 can define 3D assets that are restricted fromspecific brand modules 112 and/or applications 122 to maintainconsistent or inconsistent visual effect. The content standards 114 canbe implemented in the asset lookup and delivery service 110 to regulatecontent provided to the applications 122. The content standards 114 canalso be implemented in applications 122 and/or the user interface 124 aspart of the asset transfer client 116 to regulate content downloaded andcached at the applications 122 and/or the user interface 124.

The artist tools 108, the content conversion system 106, and the readyroom VR 120 may be supporting systems to the system 100. Statedotherwise, they may be supplemental and/or ancillary to the system 100,such that they could be implemented separately and distinctly (e.g., ona different computing device, network, or the like) from other elementsof the system 100. The artist tools 108 can modify 3D assets to make the3D assets compatible with the 3D character SDK 118. The contentconversion system 106 can convert the 3D content 102 to be performant(e.g., to perform well, such as within performance metrics) for run timeapplications. The content conversion system 106 can also convert the 3Dcontent 102 to be compatible with the 3D character SDK 118. The 3Dcontent 102 can include, for example, high fidelity photo-real assetsand/or low fidelity game-ready assets. The 3D content 102 can becreated, for example, by a 3D content creator such as a Daz® 3Dapplication.

The ready room VR 120 can be an application. The ready room VR 120 canbe a hub and/or a starting point for persistent virtual identitycreation. The ready room VR 120 can also be a default process for movingpersistent virtual identities between applications.

The 3D character SDK 118 can enable a base figure (e.g., a base 3D assetrepresenting an avatar that is part of a persistent virtual identity, orother base 3D asset) to be changed into any shape and/or size and retainfull functionality for fitting clothing, animating, and/or customizing.Using the 3D character SDK 118, the base 3D asset can be extendable to apotentially unlimited number of variations for creation of a uniqueavatar. Stated otherwise, characteristics of a 3D asset can be modifiedin a potentially unlimited number of combinations of variations. Thenthe system 100 can enable the resultant unique avatar to retain a visualidentity across artistic stylings (e.g., if the application 122 aimplements a first styling, for example a cartoon styling, and theapplication 122 b implements a second styling, for example a realisticstyling, then the unique avatar can retain a visual identity as theavatar is shown in a cartoon styling in the application 122 a and arealistic styling in the application 122 b). The 3D character SDK 118can include a number of modules and/or services for performing specificoperations to modify or otherwise configure characteristics of 3Dassets. For example, the 3D character SDK 118 can include a morphingmodule, a joint center transform (JCT) bone module, a standard shapemodule, a projection module, a head scanning to a dynamic mesh fittingmodule, a heterogeneous mesh behavior module, a hair module, and a smartprops module.

The artist tools 108 is one or more standalone modules, potentiallyincluding computer-readable instructions configured to convert 3D assetsto a form/format compatible with the system 100. The artist tools 108can receive a 3D asset (e.g., geometry), which may be configured in anumber of different formats. The artist tools 108 can be configured togroup the geometry into items; set up the level of details (LODs) for anitem; generate geographical maps (geomaps); add self-defining behavioralinformation to objects for runtime simulation; set up materials andgenerate materials for different platforms; configure the geometries'multilayered characteristics for runtime-optimized multilayer depth andvolumetric preservation between meshes; and/or set up zones on items forheterogeneous mesh deformation (e.g., so that something like metaldeforms differently than cloth to an avatar's shape). As used herein ageomap comprises geometry, a vertex index, and a map outlining anoptimized correlation between a following mesh and base mesh to be usedfor real time calculation and generation of multilayer depth solutionsand/or projection solutions. Projection references the act of projectinga deformer from one mesh to another.

The artist tools 108 also set up the custom shaping of a base 3D assetand set up the 3D assets into specific art styles to allow automaticavatar preservation between art styles. The output of the artist tools108 can be either a single 3D asset and/or a collection of 3D assetswhich can be compatible with the 3D character SDK 118. The 3D assetsmodified by the artist tools 108 can be uploaded to the asset lookup anddelivery service 110. The 3D assets can further be configured at theasset lookup and delivery service 110 for user specified distributionbased upon rules and conditions associated with the 3D asset and asprovided by the brand modules 112.

The ready room VR 120 can be a base application that facilitatesinteraction between a user and the system 100. A base application can bedifferent from the applications 122, such that the base application is astandalone application that can be executed independently from theapplications 122. The user can create and customize a 3D asset via theready room VR 120 using additional content (e.g., following 3D assets)converted with the artist tools 108, made available through the assetlookup and delivery service 110, delivered through the asset transferclient library 116, and passed to the 3D character SDK 118. For example,the user can, via the user interface 124, access the ready room VR 120to create and/or customize a 3D asset and launch at least one of theapplications 122 through the ready room VR 120.

In some examples, the user can create and customize an avatar (orotherwise configure a base 3D asset) via the application 122 b. Forexample the user can access the application 122 b and through theapplication 122 b access the ready room VR 120, or functionality of theready room VR 120 (e.g., to create and customize a 3D asset). Stateddifferently, functionality of the ready room VR 120 may be implementedor otherwise integrated with the application 122 b, such that a user ofthe application 122 b can create and/or customize an avatar or other 3Dassets within the a context of the application 122 b.

The ready room VR 120 can showcase the core functionality of the system100 from an end user's perspective. The ready room VR 120 can provideboth a place to customize a 3D asset, including an avatar, a shapeand/or clothing associated with the 3D asset, and a place to demonstratethe process and/or standards of “walking between applications.” Theready room VR 120 provides multiple means to transfer an identitybetween applications 122, interconnect between multiple open VRapplications 122, and incorporate face scan data onto the avatar. Theready room VR 120 can provide different example implementations of auser interface (UI) for shopping, previewing, and/or checking out ofstores, among different types of checkout processes.

Once compatible content is acquired, a user can use and customize the 3Dasset. A persistent virtual identity for the user can be created, andthen the user can activate a mechanism to allow an acquired and/orcreated 3D asset (e.g., avatar) to transport (e.g., transfer) or stepinto any one of the applications 122. That is, a 3D asset associatedwith a user can retain an identity as the 3D asset transitions from theready room VR 120 into one of the applications 122, and then provide endpoints for the user to return to the ready room VR 120. The virtualidentity of a user, including a corresponding avatar or other 3D asset,can be maintained consistent across multiple applications 122, and asthe virtual identity is transported from one application 122, to theready room VR 120, and/or to another application 122. The 3D asset canalso extract and retain items (e.g., a virtual weapon, or other object3D asset) from the applications 122 that can persist in the ready roomVR 120 as the 3D asset transitions from one of the applications 122 intothe ready room VR 120 and then to another of the applications 122.

The persistent virtual identity can be associated with, andrepresentative of a user that is external to the system 100. A user canbe a human user and/or an automated user.

In some examples, transitioning a 3D asset from a first application(e.g., application 122 a) to a second application (e.g., application 122b) can include conforming to standards set by the second application.The standards can include a specific art style and/or theme.Transitioning a 3D asset from a first application to a secondapplication can include placing the 3D asset in a VR room (e.g., lobby)of the first application 122 a where the user and/or the 3D characterSDK can initiate the required changes to the 3D asset before fullytransitioning the 3D asset to the second application.

The transfer of 3D assets between applications includes configuring a 3Dasset so that the 3D asset's customizations are retained as the 3D assettransitions from one application to a different application, such thatthe settings and status of the 3D asset remain the same. The transfer of3D assets is one example of a persistent virtual identity. The transferof 3D assets can be accomplished by utilizing a local backdoor moduleand/or a remote restore module. These modules enable the transfer of anidentity between applications 122.

The local backdoor module can include an application 122 a calling theasset transfer client 116 to export a 3D asset (e.g., a 3D asset file)and/or a persistent virtual identity (e.g., an identity file) comprisinggeometry, skinning, rig, textures, materials, and shaders of the current3D asset with associated items in use, and/or any additional metadatadescribing the 3D asset and/or persistent virtual identity. After theexport is finished, the application 122 a launches the application 122 bwith reference to the local identity file, and then shuts itself down.The application 122 b can access the identity and request the localidentity definition from the asset transfer client 116 and load theidentity into the application 122 b.

The remote restore module can be configured to cause the application 122a to call the asset transfer client 116 to push the identity definitionmetadata to the asset lookup and delivery service 110. The application122 a can then launch the application 122 b with an identity string, andthen shut itself down. The application 122 b can request that the assettransfer client 116 call the asset lookup and delivery service 110requesting the identity string. The application 122 b can likewiseretrieve metadata associated with the persistent virtual identity. Theapplication 122 b can use either local 3D assets (e.g., locally stored)or remote 3D assets (e.g., streamed or otherwise provided or accessedfrom a remote location) to render the avatar.

In some examples, the asset transfer client 116 can comprise one or morecomponents. For example, the asset transfer client 116 can comprise aclient and a server. The client can be implemented in the applications122 and/or computing devices on which the applications 122 areexecuting. The server of the asset transfer client 116 can beimplemented in the system 100. The client can communicate with theserver to transfer a 3D asset from the system 100 to the computingdevice of the applications 122.

To transfer a 3D asset and/or persistent virtual identity betweenapplications, the user can select a destination application 122 b from asource application 122 a. Once selected, a gate or portal may begenerated within the source application 122 a. The source applicationmay portray the gate and/or portal as a visual appearance branded forthe destination application 122 b. The gate and/or portal may transitionthe 3D asset and/or persistent virtual identity from the sourceapplication 122 a to virtual space (e.g., referred to as the “airlock”)that is configurable and customized by the destination application 122 b(e.g., a destination application vendor and/or the corresponding brandmodule 112 b). The mechanism to trigger the transfer of a 3D asset mayinclude walking and/or other locomotion methods within a VR environmentprovided by the source application 122 a toward the gate or portal ofthe destination application 122 b.

The transferring of the 3D asset and/or the persistent virtual identityfrom source application to the virtual space through the virtual portalmay trigger a VR passport check. The VR passport check compares clothingand/or an art style associated with the 3D asset and/or the persistentvirtual identity with vendor specific standards of the destinationapplication 122 b. If the 3D asset and/or persistent virtual identitydoes not conform to the destination application 122 b, then the user isprovided an opportunity to change clothing, art style, or any otheraspect associated with the 3D asset and/or persistent virtual identity,to meet the destination application standards. Once the standards aremet, a launch mechanism, through another virtual portal, the pushing ofa button, or the act of meeting the standards, will initiate a transferof the 3D asset and/or the persistent virtual identity between thesource application 122 a and the destination application 122 b.

A set of standards between applications 122 and vendors can be defined.The standards can foster an increased level of persistence and transferto exist between different applications 122. The standards enableenhanced functionality to allow standard behavior and transfer of assetsor mechanics between disparate applications 122. For example, anapplication agnostic content interchange can be defined to facilitatethe association between 3D assets and/or persistent virtual identitiesand a given application 122 a (e.g., a source application 122 a) and thetransfer of the persistent virtual identity to other applications 122(e.g., a destination application 122 b). Transferring the persistentvirtual identity and/or 3D asset can include losing permanence in thesource application 122 a and creating permanence in the destinationapplication 122 b with a conforming set of behaviors, mechanics, andappearances.

In some examples, face scan data can be associated with a dynamic mesh.Associating scan data with a dynamic mesh can include taking face scandata and changing a base figure, associated with the 3D asset and/orpersistent virtual identity, to incorporate the face scan data such thatthe base figure retains the same mesh topology while retainingfunctionality for further shaping of the mesh (e.g., making the facenarrower, nose larger, ears pointed, etc.).

The face scan data can be placed on a dynamic mesh. The face scan datacan be 3D scanner generated and/or photogrammetry generated (e.g., meshand texture). The face scan data can also be generated using variousimages and/or other means. Placing the face scan data on a dynamic meshcan deform the base figure associated with a 3D asset and/or persistentvirtual identity to match the visual appearance of the face scan data.Placing the face scan data on a dynamic mesh can generate texture tomatch the face scan data on the base figure associated with the 3Dassets and/or persistent virtual identity.

The face scan data can be compared with the base figure to identifywhere key facial and head landmarks are on both sets of data (e.g., facescan data and base figure and/or base 3D asset). The base meshassociated with the base figure is deformed to the same shape as theface scan data using automated adjustments of existing blend shapes foreach key region of the face. In some examples, a new blend shape can begenerated for the base figure to match the face scan data. The face scangenerated texture can be analyzed and, using key face and headlandmarks, the texture can be rebuilt to fit the base figure's UV map.The face scan generated texture can comprise multiple texture files. Themultiple texture files can be combined into a single texture file forthe head of a base figure. Fitting face scan data to a base figure canbe performed using a custom rig and geomap technology to compare andmatch the base figure mesh to the face scan data. As used herein, blendshaping, morphing, and deforming references a set of data attached to amesh which contains positional deltas on geometry and bones to allow themesh to change shape while not changing its fundamental geometry and/orrig.

When configuring an avatar, if there is face scan data associated withthe 3D asset and/or the application identity associated with the 3Dasset, the ready room VR 120 can associate the face scan data with the3D asset such that the 3D asset retains the full customization andcompatibility of the base figure without any scanned data. As such, a 3Dasset can be configured with the face scan data. The face scan data canbe provided, by the user, by uploading a mesh to a server associatedwith system 100 through at least one of a web form or mobileapplication.

As used herein, the system 100 can be implemented in a single computingdevice and/or over a plurality of computing devices. For example, eachof the components of the system 100 can be implemented using independentcomputing devices coupled via a network. In some examples, the system100 can be implemented using cloud services.

FIG. 2 is a block diagram of artist tools 408, according to oneembodiment. The artist tools 408 includes an import module 460, amaterials module 462, a geometry module 464, an application module 468,and a preflight module 470.

A user (e.g., 3D artist) can export content 456 created using a 3Dcontent creation application (e.g., Maya, Blender, and/or 3DS Max) to afilmbox format (e.g., FBX), a portable network graphic (PNG) format,and/or a joint photographic expert group (JPEG) format (e.g., JPGformat), among other possible formats. The 3D artist can also exporttextures and materials, in standard formats, associated with the contentcreated using the 3D content creation application.

The artist tools 408 is a standalone application that imports thecontent 456 (e.g., in the standard format exported from the 3D contentcreation application) and configures the content 456 to be compatiblewith the 3D character SDK. The content 456 can be imported via theimport module 460. The content 456 can include user created geometry andtextures.

The user can then create a new project and import the content 456 (e.g.,FBX file) into the project. The content 456 can include geometry,materials, rig, and/or textures. The content 456 can be parsed. Theorganize geometry module 464 enables a user to organize the geometryinto items. The user can also create metadata and associate the metadatawith the items to allow the items to be identified. The metadata canprovide an automatic behavior associated with the items. The metadatacan also provide a level of detail groups for the items.

The artist tools 408 can also configure new materials or select existingmaterials via the materials module 462. The artist tools 408 can alsoapply the material to the items via the application module 468 byassociating the materials with the corresponding items. Once set up, theitems are prepped and tested to ensure that the items function properly.The items can be tested via the preflight module 470. The test caninclude geomap generation, alpha injection mapping using multilayerdepth preservation techniques, auto skinning of the asset if needed,setting up heterogeneous mesh behavior, and/or more.

Once the tests are complete, a user (e.g., 3D artist), via the artisttools 408, can drive the content through fitting to a base figure, andtest out the deformation and animation to ensure that the contentfunctions properly. The user can make adjustments as necessary to ensurethat the content functions properly. The artist tools 408 can thenexport the items in standard formats to other applications. The artisttools 408 can also export the items in formats accepted/recognized bythe 3D character SDK.

As mentioned above, the Artist Tools 108, 408 are one or more standalonemodules configured to generate, for example, geographical maps, alphainjection maps, and heterogeneous mesh indexes. The artist tools 108,408 (e.g., the preflight module 470) may use these maps and indexes totest items.

FIG. 3 illustrates a flow chart 500 for determining the neighborvertices index, to determine how an item (e.g., item asset or item 3Dasset) correlates to a base figure (e.g., a base figure asset, base 3Dasset). Neighboring vertices can be numbered between 1 and N, where N isthe number of vertices in the base figure. For practical purposes, anupper limit of 10 vertices is generally imposed on the base figure, witha default of 4 vertices. However, N can be any number desired to createa more accurate neighboring vertices index and can be changed as needed.

The artist tools 108, 408 loads 502 the base figure and the item. Theitem is placed on top of the base figure as it would normally functionor be fitted onto a 3D asset. Preferably, the neighboring vertices aredetermined 504 using a k-dimensional (k-d) tree algorithm and alsodetermined 506 by traversing the geometry using a geodesic algorithm ona combined mesh of the base figure and the item. The results of the k-dtree algorithm and the geodesic algorithm are combined 508 to determinea more accurate result of neighboring vertices. However, in otherembodiments, only a single algorithm, either a k-d tree algorithm or ageodesic algorithm, is run to determine the neighboring vertices, and acombination of the algorithms is omitted.

An example of using a combination of a k-d tree algorithm and a geodesicalgorithm would be using the geodesic algorithm in all directions todetermine the nearest neighboring vertices in the base figure and thenusing the k-d tree algorithm to determine the straight path nearestneighbors. With both data sets of nearest neighbors, the one or moremodules of the artist tools 108 or 408 compares the geodesic distancesbetween the geodesic neighbors and the k-d tree neighbors to determinethe best nearest neighbors vertices of a base figure. This generates theinitial neighboring vertices index.

Once the initial neighboring vertices index is determined, the artisttools 108 or 408 receives 510 a manual selection from a creator or user.The manual selection designates a selection of a point on the item by acreator or user and hand painting the vertices from the base figure toderive influence on that point on the item. This allows a user to modifythe neighboring vertices index (in effect overriding the generatedneighboring vertices index) to get the desired effect of the creator orartist.

The neighboring vertices index data is saved 512 into the index based ona key value designating portions of the base figure or item. Forexample, the neighboring vertices index can be saved into the indexbased on base figure vertex, base figure polygon, item vertex, orinfluencing bones, or grouped by regions such as head, body, arms, legs,hands, etc.

A k-d tree (or k-dimensional tree) is a binary tree in which every nodeis a k-dimensional point. Each internal node implicitly generates asplitting hyperplane that divides the space into two parts, known ashalf-spaces. Points to the left of this hyperplane are represented bythe left subtree of the selected internal node and points right of thehyperplane are represented by the right subtree of the selected internalnode. The hyperplane direction is chosen by: each node in the tree isassociated with one of the k-dimensions, the hyperplane beingperpendicular to the associated dimension's axis. For example, if the“x” axis is chosen, points in the subtree with a smaller “x” value thanthe node appear in the left subtree and points with larger “x” valueappear in the right subtree. The hyperplane is set to the x-value of thepoint, and the normal is the unit x-axis.

Geodesic algorithms can determine a shortest path between a source on amesh and one or more destinations of the mesh. For example, an algorithmby Mitchell, Mount, and Papadimitriou (MMP) partitions each mesh edgeinto a set of intervals (windows) over which the exact distancecomputation can be performed atomically. These windows are propagated ina “continuous Dijkstra”-like manner.

FIG. 4 illustrates a flow chart 600 for generating the occlusion indexand the alpha injection map. The occlusion index represents whichpolygons in the base figure the item is fully occluding and partiallyoccluding. The alpha injection map is a per pixel representation of thearea that the item covers of the base figure as represented in a UVspace. The occlusion index and the alpha injection map are used byalgorithms that fix multilayered depth issues in a 3D asset and aid incombining meshes and textures into a single geometry.

Initially, the artist tools 108 or 408 loads 602 the base figure and theitem. In some embodiments, a bounding box optimization 604 may beperformed. The bounding box optimization 604 includes directlyoverlaying a bounding box of the non-edge polygons of the item on thebase figure. Everything in the base figure that is within the boundingbox is marked as fully occluded. This results in the number of polygonsthat rays must be shot from, as discussed in more detail below, beingreduced because rays do not need to be shot from the fully occludedpoints since they have already been marked as fully occluded.

The polygons of the item are traversed, and using ray tracing, rays areshot 606 from each vertex and center points of the polygon of the itemfrom both sides of the polygon at a 90-degree angle from the plane ofthe polygon. If one of the two rays shot 606 from each point of thepolygon of the item collides with a polygon in the base figure, therelationship between the item polygon occluding the base figure isrecorded. Then, the same ray trace method is performed on the collidedpolygons of the base figure, and hits and misses are recorded. If thereare no misses of the ray, that polygon is considered fully occluded. Ifthere is a miss where either ray from a given point in the base figurecollides with the item within a short distance constraint, the polygonis marked as partially occluded. This is then saved into a polygonocclusion index for quick lookup. Each occlusion can be keyed in theindex, as discussed above with respect to FIG. 3.

Using the overlay data from the bounding box optimization 604 and thepolygon hit from the ray tracing algorithm, an alpha injection image mapis generated 608 that mimics the UV map of the base figure butrepresents the part of the base figure UV map where the polygons of theitem overlay. The UV map and the overlay of the project image are usedto generate a new image that consists of only the overlaid parts of thebase figure to generate a pixel representation of the polygons occludedon the base figure. This is then keyed 610 to the index for quicklookup.

The image generation map is keyed to the index in the same manner asdiscussed above with respect to FIG. 3.

FIG. 5 illustrates a flow chart 700 for generating a heterogeneous meshbehavior index. Normal geometry for form fitting materials will deformdifferently on a 3D asset than metal or flowing dynamic cloth. When anunderlying figure, or 3D asset, is made taller or more muscular, normalgeometry will deform in the X, Y, and Z axes the same amount as the basefigure. Other materials, such as metal, stay rigid and do not scale, orjust scale in an equal amount of 1:1:1 as the 3D asset scaled along agiven axis.

The heterogeneous mesh index is a representation of polygons andvertices, or groups of polygons and vertices, and what kind of realworld material the polygons and vertices should behave like; what pivotpoints scale, rotate, or transform from; and in which directions alongthe X, Y, and Z axes the polygons or vertices behave.

To generate the heterogeneous mesh index, the artist tools 108 loads 702the item. The artist tools 108 or 408 receives 704 a manual selection ofvertices or polygons of the item, which can include a singular vertex orpolygon, or a group of vertices and polygons that scale together. Theartist tools 108 or 408 also assigns 706 the type of behavior to theselected vertices or polygons of the item for scaling based on anothermanual selection by a creator or user. The assignment 706 of thebehavior is saved 708 within the heterogeneous mesh index. This is donefor each desired vertices or polygons, or group of vertices andpolygons, to create the entire heterogeneous mesh index.

For example, a belt item consists of a belt strap and square beltbuckle. The polygons and/or vertices of the belt strap may be selectedand configured by the creator as normal geometry. Then, if an underlyingbase figure is scaled, the belt strap scales normally with theunderlying 3D asset. The polygons and/or vertices of the belt buckle maybe selected and configured as metal. When the underling base figure isscaled, the belt buckle scales along its X, Y, and Z axes in a 1:1:1ratio so that the belt buckle does not become rectangular ortrapezoidal.

FIG. 6 is a block diagram of an identity system, according to oneembodiment The mobile device identity system 881 can generate apersistent virtual identity that can be transferred betweenapplications, potentially on different application systems 822. Theidentity system 881 can include a memory 820, one or more processors893, a network interface 894, an input/output interface 895, and asystem bus 896. The identity system 881 may be the same as or analogousto the interface system 100 in FIG. 1. The identity system 881 mayinterface with one or more VR application systems 822 via acommunication network 12. The identity system 881 may provide persistentvirtual identity for the VR application systems 822. The identity system881 may also interface with one or more content creation applicationsystem 856 to obtain 3D assets.

The one or more processors 893 may include one or more general purposedevices, such as an Intel®, AMD®, or other standard microprocessor. Theone or more processors 893 may include a special purpose processingdevice, such as ASIC, SoC, SiP, FPGA, PAL, PLA, FPLA, PLD, or othercustomized or programmable device. The one or more processors 893 canperform distributed (e.g., parallel) processing to execute or otherwiseimplement functionalities of the presently disclosed embodiments. Theone or more processors 893 may run a standard operating system andperform standard operating system functions. It is recognized that anystandard operating systems may be used, such as, for example, Microsoft®Windows®, Apple® MacOS®, Disk Operating System (DOS), UNIX, IRJX,Solaris, SunOS, FreeBSD, Linux®, ffiM® OS/2® operating systems, and soforth.

The memory 820 may include static RAM, dynamic RAM, flash memory, one ormore flip-flops, ROM, CD-ROM, DVD, disk, tape, or magnetic, optical, orother computer storage medium. The memory 820 may include a plurality ofprogram engines and/or modules 882 and program data 888. The memory 820may be local to identity system 881, as shown, or may be distributedand/or remote relative to the identity system 881.

The program engines 882 may include all or portions of other elements ofthe identity system 881. The program engines 882 may run multipleoperations concurrently or in parallel with or on the one or moreprocessors 893. In some embodiments, portions of the disclosed modules,components, and/or facilities are embodied as executable instructionsembodied in hardware or in firmware, or stored on a non-transitory,machine-readable storage medium, such as the memory 820. Theinstructions may comprise computer program code that, when executed by aprocessor and/or computing device, cause a computing system (such as theprocessors 893 and/or the identity system 881) to implement certainprocessing steps, procedures, and/or operations, as disclosed herein.The engines, modules, components, and/or facilities disclosed herein maybe implemented and/or embodied as a driver, a library, an interface, anAPI, FPGA configuration data, firmware (e.g., stored on an EEPROM),and/or the like. In some embodiments, portions of the engines, modules,components, and/or facilities disclosed herein are embodied as machinecomponents, such as general and/or application-specific devices,including, but not limited to: circuits, integrated circuits, processingcomponents, interface components, hardware controller(s), storagecontroller(s), programmable hardware, FPGAs, ASICs, and/or the like.Accordingly, the modules disclosed herein may be referred to ascontrollers, layers, services, engines, facilities, drivers, circuits,and/or the like.

The memory 820 may also include program data 888. Data generated by theidentity system 881, such as by the program engines 882 or othermodules, may be stored on the memory 820, for example, as stored programdata 888. The stored program data 888 may be organized as one or moredatabases. In certain embodiments, the program data 888 may be stored ina database system. The database system may reside within the memory 820.In other embodiments, the program data 888 may be remote, such as in adistributed computing and/or storage environment. For example, theprogram data 888 may be stored in a database system on a remotecomputing device.

The input/output interface 895 may facilitate interfacing with one ormore input devices and/or one or more output devices. The inputdevice(s) may include a keyboard, mouse, touch screen, light pen,tablet, microphone, sensor, or other hardware with accompanying firmwareand/or software. The output device(s) may include a monitor or otherdisplay, printer, speech or text synthesizer, switch, signal line, orother hardware with accompanying firmware and/or software.

The network interface 894 may facilitate communication with othercomputing devices and/or networks and/or other computing and/orcommunications networks. The network interface 894 may be equipped withconventional network connectivity, such as, for example, Ethernet (IEEE802.3), Token Ring (IEEE 802.5), Fiber Distributed Datalink Interface(FDDI), or Asynchronous Transfer Mode (ATM). Further, the networkinterface 894 may be configured to support a variety of networkprotocols such as, for example, Internet Protocol (IP), Transfer ControlProtocol (TCP), Network File System over UDP/TCP, Server Message Block(SMB), Microsoft® Common Internet File System (CIFS), Hypertext TransferProtocols (HTTP), Direct Access File System (DAFS), File TransferProtocol (FTP), Real-Time Publish Subscribe (RTPS), Open SystemsInterconnection (OSI) protocols, Simple Mail Transfer Protocol (SMTP),Secure Shell (SSH), Secure Socket Layer (SSL), and so forth.

The system bus 896 may facilitate communication and/or interactionbetween the other components of the identity system 881, including theone or more processors 893, the memory 820, the input/output interface895, and the network interface 894.

As noted, the identity system 881 also includes various program engines882 (or modules, elements, or components) to implement functionalitiesof the identity system 881, including an asset transfer client engine883, an asset lookup and delivery service engine 884, an artist toolsengine 885, a 3D character SDK engine 886, and/or a ready room VR engine887. These elements may be embodied, for example, at least partially inthe program engines 882. In other embodiments, these elements may beembodied or otherwise implemented in hardware of the identity system881. The identity system 881 also includes identity data 889 and 3Dasset data 890 that may be stored in the program data 888 which may begenerated, accessed, and/or manipulated by the program engines 882.

Example Embodiments

Example 1 is a system for generating a nearest neighboring verticesindex for rendering assistance, the system comprising a memory and oneor more processors. The memory is configured to store and retrieve thenearest neighboring vertices index, a base figure asset and an itemasset. One or more processors configured to: load the base figure assetand the item asset from the memory, select an item vertex of the itemasset, and generate, using a k-dimensional tree algorithm or a geodesicalgorithm a set of nearest neighbor vertices between the item vertex andvertices of the base figure asset, the set of nearest neighbor verticeslimited to a maximum threshold. One or more processors configured to:create the nearest neighboring vertices index based at least in part onthe set of nearest neighbor vertices, present, in a user interface, anoption to override or add vertices to the nearest neighboring verticesindex, generate one or more influence indexes relating to a portion of aderived mesh derived from the base figure asset and the item asset, andrender the derived mesh based at least in part on the one or moreinfluence indexes.

Example 2 is the system of Example 1, wherein an influence index fromthe one or more influence indexes is a region.

Example 3 is the system of Example 2, wherein the region is defined as ahead, body, arms, legs, or hands.

Example 4 is the system of Example 1, wherein the maximum threshold is anumber of vertices.

Example 5 is the system of Example 1, wherein a size of the set ofnearest neighbor vertices is set to a default number of vertices.

Example 6 is the system of Example 1, wherein the one or more processorsfurther comprises a graphics processor.

Example 7 is the system of Example 1, wherein to generate the set ofnearest neighbor vertices between the item vertex and vertices of thebase figure asset further comprises to use both the k-dimensional treealgorithm and the geodesic algorithm.

Example 8 is the system of Example 1, further comprising a virtualreality interface configured to transmit the derived mesh for display.

Example 9 is the system of Example 1, wherein the base figure asset isan avatar.

Example 10 is a computer program product comprising a computer-readablestorage medium that stores instructions for execution by a processor toperform operations of a polygon occlusion portion of a rendering system,the operations, when executed by the processor, to perform a method. Themethod comprising: loading a base asset and an item asset from memory,wherein the base asset comprises a base set of polygons and the itemasset comprises an item set of polygons, overlaying a bounding box ofnon-edge polygons within the item asset on the figure asset, andindicating, within a polygon occlusion index, polygons of the base assetwithin the bounding box as occluded. The method comprising: for vertexand center points of item polygons in the item set of polygons, tracingitem rays from both sides of an item polygon at a 90-degree angle from aplane defined by the item polygon and determining whether the rayscollide with a polygon from the base set of polygons, when an item raycollides with a base polygon from the base set of polygons, store arelationship set of relationships between the item polygon and the basepolygon, the item polygon associated with the item ray, and reducing therelationship set to form a subset of the relationship set by removingrelationships that include base polygons within the polygon occlusionindex from the overlaying the bounding box operation. The methodcomprising: vertex and center points of base polygons in the subset ofthe relationship set, tracing item rays from both sides of the basepolygon at a 90-degree angle from a plane defined by the base polygonand determining whether the rays collide with a polygon from the itemset of polygons, when at least one ray from each of the vertex andcenter points of the base polygon in the subset of the relationship setintersect one or more item polygons, add the base polygon to the polygonocclusion index as occluded, and when one or more one rays from each ofthe vertex and center points of the base polygon in the subset of therelationship set intersect one or more item polygons, but less than aray from each of the vertex and center points of the base polygon, addthe base polygon to the polygon occlusion index as partially occluded.

Example 11 is the computer program product of Example 10, wherein themethod further comprises: generate an image map that represents portionsof a base UV map that is covered by polygons of the item asset based atleast in part on the polygon occlusion index; and overlay the image mapon the base UV map to form an image that identifies a pixelrepresentation of occluded areas on the base asset.

Example 12 is the computer program product of Example 11, wherein theoccluded areas are represented by pixels in the image.

Example 13 is the computer program product of Example 11, wherein theimage is an alpha injection map used to modify the base UV map with anitem UV map using the representation of occluded areas on the baseasset.

Example 14 is the computer program product of Example 11, wherein theimage is used to form a combined image map for a combined mesh, thecombined mesh including the base asset and the item asset.

Example 15 is a method for heterogeneous mesh behavior in a renderingsystem, the method comprising: loading an item asset, processing aselection of a set of vertices or polygons from an input, defining a setof behavior types for the selection, the behavior types defining rulesincluding scaling rules, transform rules, or rotation rules, and storingan indication of the selection and the behavior types in a heterogeneousbehavior index.

Example 16 is the method of Example 15, wherein the method furthercomprises to: process one or more deformation instructions of one ormore of the vertices or polygons from the selection of the set ofvertices or polygons; and apply the behavior types to the one or moredeformation instructions with the behavior types having a priority overa conflicting deformation instruction included in the one or moredeformation instructions.

Example 17 is the method of Example 15, wherein defining the set ofbehavior types further comprises selecting a grouping of behavior types.

Example 18 is the method of Example 17, wherein the grouping is definedby a material type.

Example 19 is the method of Example 15, wherein the rules compriseconstraints.

Example 20 is the method of Example 15, wherein processing the selectionof the set of vertices or polygons from the input further comprisesreceiving the input from an artist tools system.

The described features, operations, or characteristics may be arrangedand designed in a wide variety of different configurations and/orcombined in any suitable manner in one or more embodiments. Thus, thedetailed description of the embodiments of the systems and methods isnot intended to limit the scope of the disclosure, as claimed, but ismerely representative of possible embodiments of the disclosure. Inaddition, it will also be readily understood that the order of the stepsor actions of the methods described in connection with the embodimentsdisclosed may be changed as would be apparent to those skilled in theart. Thus, any order in the drawings or Detailed Description is forillustrative purposes only and is not meant to imply a required order,unless specified to require an order.

Embodiments may include various steps, which may be embodied inmachine-executable instructions to be executed by a general-purpose orspecial-purpose computer (or other electronic device). Alternatively,the steps may be performed by hardware components that include specificlogic for performing the steps, or by a combination of hardware,software, and/or firmware.

Embodiments may also be provided as a computer program product includinga computer-readable storage medium having stored instructions thereonthat may be used to program a computer (or other electronic device) toperform processes described herein. The computer-readable storage mediummay include, but is not limited to: hard drives, floppy diskettes,optical disks, CD-ROMs, DVD-ROMs, ROMs, RAMs, EPROMs, EEPROMs, magneticor optical cards, solid-state memory devices, or other types ofmedium/machine-readable medium suitable for storing electronicinstructions.

As used herein, a software module or component may include any type ofcomputer instruction or computer executable code located within a memorydevice and/or computer-readable storage medium. A software module may,for instance, comprise one or more physical or logical blocks ofcomputer instructions, which may be organized as a routine, program,object, component, data structure, etc., that performs one or more tasksor implements particular abstract data types.

In certain embodiments, a particular software module may comprisedisparate instructions stored in different locations of a memory device,which together implement the described functionality of the module.Indeed, a module may comprise a single instruction or many instructions,and may be distributed over several different code segments, amongdifferent programs, and across several memory devices. Some embodimentsmay be practiced in a distributed computing environment where tasks areperformed by a remote processing device linked through a communicationsnetwork. In a distributed computing environment, software modules may belocated in local and/or remote memory storage devices. In addition, databeing tied or rendered together in a database record may be resident inthe same memory device, or across several memory devices, and may belinked together in fields of a record in a database across a network.

It will be obvious to those having skill in the art that many changesmay be made to the details of the above-described embodiments withoutdeparting from the underlying principles of the invention. The scope ofthe present invention should, therefore, be determined only by thefollowing claims.

1-14. (canceled)
 15. A method for heterogeneous mesh behavior in arendering system, the method comprising: loading an item asset;processing a selection of a set of vertices or polygons from an input;defining a set of behavior types for the selection, the behavior typesdefining one or more rules each comprising a scaling rule, a transformrule, or a rotation rule; and storing an indication of the selection andthe behavior types in a heterogeneous behavior index.
 16. The method ofclaim 15, wherein the method further comprises to: process one or moredeformation instructions of one or more of the vertices or polygons fromthe selection of the set of vertices or polygons; and apply the behaviortypes to the one or more deformation instructions with the behaviortypes having a priority over a conflicting deformation instructionincluded in the one or more deformation instructions.
 17. The method ofclaim 15, wherein defining the set of behavior types further comprisesselecting a grouping of behavior types.
 18. The method of claim 17,wherein the grouping is defined by a material type.
 19. The method ofclaim 15, wherein the rules comprise constraints.
 20. The method ofclaim 15, wherein processing the selection of the set of vertices orpolygons from the input further comprises receiving the input from anartist tools system.
 21. A system to perform operations of definingheterogeneous mesh behavior for rendering, the system comprising: memoryconfigured to store and retrieve a heterogeneous behavior index; one ormore processors configured to: load an item asset; process a selectionof a set of vertices or polygons from an input; define a set of behaviortypes for the selection, the behavior types defining one or more ruleseach comprising a scaling rule, a transform rule, or a rotation rule;and store an indication of the selection and the behavior types in theheterogeneous behavior index.
 22. The system of claim 21, wherein theone or more processors are further configured to: process one or moredeformation instructions of one or more of the vertices or polygons fromthe selection of the set of vertices or polygons; and apply the behaviortypes to the one or more deformation instructions with the behaviortypes having a priority over a conflicting deformation instructionincluded in the one or more deformation instructions.
 23. The system ofclaim 21, wherein to define the set of behavior types, one or moreprocessors are further configured to select a grouping of behaviortypes.
 24. The system of claim 23, wherein the grouping is defined by amaterial type.
 25. The system of claim 21, wherein the rules compriseconstraints.
 26. The system of claim 21, wherein to process theselection of the set of vertices or polygons from the input, the one ormore processors are further configured to receive the input from anartist tools system.
 27. A computer program product comprising anon-transitory computer-readable storage medium that stores instructionsthat when executed by a processor perform operations for a heterogeneousmesh behavior portion of a rendering system, comprising: loading an itemasset; processing a selection of a set of vertices or polygons from aninput; defining a set of behavior types for the selection, the behaviortypes defining one or more rules each comprising a scaling rule, atransform rule, or a rotation rule; and storing an indication of theselection and the behavior types in a heterogeneous behavior index. 28.The computer program product of claim 27, wherein the operations furthercomprise: processing one or more deformation instructions of one or moreof the vertices or polygons from the selection of the set of vertices orpolygons; and applying the behavior types to the one or more deformationinstructions with the behavior types having a priority over aconflicting deformation instruction included in the one or moredeformation instructions.
 29. The computer program product of claim 27,wherein defining the set of behavior types further comprises selecting agrouping of behavior types.
 30. The computer program product of claim29, wherein the grouping is defined by a material type.
 31. The computerprogram product of claim 27, wherein the rules comprise constraints. 32.The computer program product of claim 27, wherein processing theselection of the set of vertices or polygons from the input furthercomprises receiving the input from an artist tools system.